Tag
7 articles
Learn how NVIDIA's new AI models Nemotron 3.5 Lightning and NeMo Switchyard work together to make AI systems more efficient and powerful by using only the right AI experts for each job.
This article explains the advanced concepts behind Inkling-Small, a 276 billion parameter multimodal MoE model that achieves efficiency through sparse activation and open weights.
This article explains Mixture of Experts (MoE) AI models, how they work like teams of specialists, and why they're important for efficient AI performance.
Learn how Kimi K3, a new AI model from Moonshot AI, uses Mixture of Experts and advanced attention methods to become more efficient and powerful than previous models.
This explainer explores the advanced Mixture of Experts (MoE) architecture used in Liquid AI's LFM2.5-8B-A1B model, examining how sparse parameter activation enables powerful on-device AI capabilities.
Learn to implement and evaluate a hybrid MoE-diffusion model that demonstrates the performance benefits of converting autoregressive LLMs into diffusion models for improved inference speed.
Learn how Mistral AI's new Mistral Small 4 model unifies instruction following, reasoning, and multimodal capabilities into one powerful AI system using Mixture of Experts technology.
